Appl. No. 09/818,427 

Amdt. dated May 23, 2006 

Reply to Office Action of January 1 1 , 2006 



This listing of claims will replace all prior versions, and listings, of claims in the 
application: 

Listing of Claims: 

Claim 1-12 (Canceled). 

Claim 13 (Currently Amended): A method for augmented reality guided 
instrument positioning, comprising the steps of: 

rendering at least one graphics path guide for indicating a path for a real 
instrument to follow to a target; 

constructing and rondor i ng at loact ono graphical axis marker; 
prov i ding th o r o ndorod at loaot ono graphicc path guide and graph i c al axi s 
mark e r to a vid o o and graphics overlay modu lo ; 

displaying the rendered at least one graphics path guide and graphical 
axis marker on a stereo display overlaid onto a view that contains said real 
instrument and a real object, which includes said target : 

ident i fying moving said real instrument to align it with the at least one 
graphics path guide. 

aligning the re al instrument with the path bv determining when the at least 
one graphics path g uide frames the path so that a view of a central part of the 
real instrument is not obstructed bv the at least one graphics path guide 
graphical axis mark e r on thn inntmm n nt th^t mnrkr nn a xi s of th e in c trum cn t, th o 
axis d is posed from a front portion to a back port i on of th o i notrum o nt, th o f r ont 
portion corr e sponding to tho point on tho target ; and 

moving said re al instrument along the path so that a front portion of said 
real instrument is inserted into the object until its tip reaches said targ et 

a lign i ng tho at least ono idontifiod graphical axio mark e r with r o cp o ct -te 
th o at lo act ono graphics guido to align tho inotrumont to tho path b y 
rep os i tio n ing th o instrum e nt w it h ro s poct to th o graph i cc guide using th o ct o roo 
display co tha tr#*e-ifl$tf um e nt movoo toward alignmot 
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Claim 14 (Canceled). 
Claim 15 (Canceled). 

Claim 16 (Currently Amended): A method for augmented reality guided 
instrument positioning, comprising the steps of: 
defining a point on an actual target; 

defining an a ctual path to reach the point on the actual targ et; 

rendering a graphical representation of the actual target point and the 
actual path in the form of a gra phical target point and at least one graphical axis 
marker, respectively, the graphical representation being rendered with respect to 
a user's augmented reality viewpoint, wherein the augmented reality view 
combines a view of a n actual scene with said graphical representation and the 
augmented reality line of sight to the graphical target point coincides with the 
actual path that the a ctual instrument needs to be aligned to during a positioning 
of the act ual instrument to the actual target point: and 

aligning the actual instrument to the actual path by aligning it to the 
augmented reality line of sight tow ards the graphical target point, and moving the 
actual instrument alon g the actual path towards the actual target point while 
keeping it aligned with the augmented reality line of sioht. 

The method accord i ng t o claim 13, further comprieing th o stop of effectively 
constructing and rond o ring a graphical axis marker by selecting an existing 
f e aturo of thn tnp.t . rum«=>nt t" be a gra p hi c a l ax ic mar ke r;. 

Claim 1 7 (Currently Amended}: The method according to claim 16 +3, further 
comprising the step of designing the actual instrument to include at least one 
physical axis marker for alignment with said at least one graphical axis marker . 



3 



AppJ. No. 09/818,427 

Amclt. dated May 23, 2006 

Reply to Office Action of January 1 1 , 2006 



Claim 1 8 (Currently Amended): The method according to claim 16 43, further 
comprising the step of adding at least one physical axis marker to a structure of 
the actual instrument for alignment with said at least one graphical axis marker . 



Claim 1 9 (Currently Amended): The method according to claim 43 16, whereby 
a user makes the augmented realit y line of sight coincide with the actual oath hy 
moving into a position where said graphical target point and said at least one 
graphical axis marker line up. 

wheroin tho at loact ono idontifiod graphical axis mark e r is an olongatod 
member. 

Claim 20 (Currently Amended): The method according to claim 43 16, wherein 
the at least one identified graphical axis marker has a circular shape, and is 
centered on the axis of the instrument actual path . 

Claim 21 (Currently Amended): The method according to claim 16, wherein the 
at least one identified graphical axis marker is a cross comprised of an 
intersection of at least two lines, the intersection to be kem^-centered on the axis 
of the actual instrument for correct alignment . 

Claim 22 (Currently Amended): The method according to claim 16 43, wherein 
the at least one identified graphical axis marker comprises at least two axis 
markers for controlling alignment of the actual instrument along a line of sight. 

Claim 23 (Currently Amended): A method for virtual reality guided instrument 
positioning, comprising the steps of: 

defining a point on an actual target! 

defining a*** an actual path to reach the point on the actual target; 
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tracking a pose of an actual instrument with respect to a pose of the actual 

target; 

rendering a graphical representation of the actual instrument and the 
actual target point to obtain a virtual instrument and a virtual target point, 
respectively, the graphical representation being rendered with respect to a virtual 
viewpoint from which a virtual line of sight to the virtual target point coincides with 
a virtual path for the virtual instrument to follow during a positioning of the actual 
instrument to the point on the actual target, the virtual path corresponding to the 
actual path, the virtual instrument comprising a 3D structure for line of sight 
alignment, the 3D structure comprising a plurality of markers centered on and 
distributed along an axis of the virtual instrument; 

prov i d i ng th o rondorod virtua l inctrumont and v i rtua l targ e t point to a v i d o o 
and graphics overlay modulo; 

displaying the rendered virtual instrument and virtual target point ©n^a 
stereo display ; and 

aligning the virtual instrument along the virtual line of sight to the virtual 
target point in order to accordingly align the actual instrument along the actual 
P atn by reposit i oning th o virtu n l inp . tmmnnt m i th r^p^t to the virtual targ e t point 
using tho stor o o display go th a t tho virtual instrumont movos toward alignment 
with tho target ; and 

moving the actual instrument along the actual path towards the actual 
target keeping the correct alignment bv observing and keeping the alignment of 
virtual instrument and virtual path. 

Claim 24 (Canceled). 

Claim 25 (Original): The method of claim 23, wherein the virtual target point has 
a circular shape. 
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Claim 26 (Original): The method of claim 25, wherein the circular shape is a ring. 
Claim 27-28 (Canceled). 

Claim 29 (Previously Presented): The method of claim 23, wherein said plurality 
of markers comprise at least two rings, centered on an axis of the virtual 
instrument. 

Claim 30 (Original): The method of claim 29, wherein the at least two rings have 
different diameters. 

Claim 31 (Currently Amended): A mothod for virtua l reality guid o d instrum e n t 
posit i oning, comprising th o stops of: 

defining a point on an actual target and an actual path to roach tho point 
o r+th e actual targ e t; 

tracking a pooo of an actual i nstrument with r o spoct to a po ao of tho actual 

target j 



^ty^Uafge^p o i nt to obtain a virtual ins t r u m e nt and a v i rtua l ta r g e t point, 
^es p o ctiv o iy, t ke-gfapl^ be i ng rond o r o d with r o sp o ct to a v i rtual 

viewpo i nt from ^Me&^^ targ e t p off^omoyes^wife 




" e s e n t at i on of-tke-aotual instrument an d t he 



ar virtual pat h for tho vi ffr 
i nstrum o n t4& 4he point s 
actual p a#H 





» follow during a posit i oning -oHhe^actaai 
l et, th o virtual path corresponding to tho 
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providing th o r o ndorod virtual inctrumont and virtual targ e t point to a vid o o 
and graph i cs ov e rlay modulo; 

dis p l aying tho rondorod virtual instrument and v i rtual targ o t po i nt on a 



The method of claim 23. wherein the step of aligning the virtual 
instrument further comprises the step of choosing an orientation of the graphical 
representation around the virtual line of sight according to a pose of a user with 
respect to the actual targetj-an€t 

al i gning tho virtual inntnim n nt n lnng thn wirt« n | | j nr 0 f c i g ht to tnQ V ,^ UJ | 
targ o t point to align tho actual in c trum o nt along th o actual path by repos i t i oning 
tho virtual inctrumont with rocpoct to th o virtua l targot point using tho ctoroo 
dtsptay so that tho virtual inctrumont movos toward alignm e nt w i th tho targot . 

Claim 32 (Original): The method of claim 31 , further comprising the step of 
determining the orientation such that east, west, north, and south correspond to 
right, left, forward, and backward, respectively, for the pose of the user in which 
the user faces the actual target, said determining step based on a selection. 

Claim 33 (Original): The method of claim 31, wherein the orientation is 
dynamically adjusted according to a change of the pose of the user. 

Claim 34 (Original): The method of claim 32, wherein the selection is dynamically 
adjusted with respect to the pose of the user. 

Claim 35 (Currently Amended): a m r .thorj fr» r virtual realit y gui d ed instr u ment 
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def i ning a po i nt on an actual targot and an actual path to reach th o point 
on tho actua l targ e t; 

tracking a poco of an actual i nctrum o nt with rospoct to a poco of tho actua l 

targ e t! 

rondoring a graphica l roprosontation of tho actual in c trum o nt and th e 
actual targot point to obt£ 
r e spect i v el y, tho gr a phical r o pr < 
viewpoint from which a virtual line of e i ght to tho v i rtua l targot point coincides with 
a virtual path for tho v i rtual instrum e nt to follow during a pocition i ng of th o actual 

a etuaf path; 

provid i ng tho rond o r o d virtual inctrumont and virtual targot point to a v i doo 

and graphics ove r lay modul o - 
d i splaying tho rond o r o d v i rtu al inctrumont and virtual targot point on a 

st e reo display; 

The method of claim 23 wherein the rendering step further comprises the 
step of rendering graphical information about a distance between the actual 
instrument and the point on the actual target, the graphical information about the 
distance being overlaid onto the graphical representationf-aod 

aligning tho virtual i nctrum o nt along th o virtual li n o of oi g frUo th e v i rtual 
targot point - to a l ign tho actual inctrumont along th o actua l path by repos i t i on i ng 
tho virtual instrument with rocpoct to tho virtual targot point - 
di sp l ay so t h at th o virtual inctrumont movoc toward 




Claim 36 (Canceled). 
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Claim 37 (Currently Amended): A method for v i rtual rea li ty guid e d i nstrum e nt 
pos i t i oning, compri s ing tho steps of; 

defining a po i nt on an actual target and an actual path to roach tho point 



tracking a poso of an actual instrumont with rocpoct to a pose of th o actual 

targ e t; 

render i ng a graphical representation of tho actual in s trument and th o 
actual target po i nt to obtain a virtual inctrument and a virtual target point, 
rospoctiv o ly, th o graphical roprooontation being rendered with r e spect to a virtual 
v ie wpo i nt from wh i ch a v i rtual l i n o of s i ght to tho virtual target point coinc i d e s w i th 
a virtual path for tho v i rtual instrument to fo l low during a pos i tioning of tho actual 
i nstrumont to tho point on th o actual target, tho virtual path corresponding to th o 
a etual path; 

and graphics ov o r l ay modulo; 

disp l ay i ng th o rendered virtual instrument and v i rtua l targot point on a 
st e reo disp la y; and 

aligning th o virtual i nstrum o nt along tho v i rtual lino of sight to tho v i rtual 
tafge^pem^te- align tho actual instrument a l ong th o actual pato The method of 
claim 23 wherein the virtual target point and the virtual instrument are designed 
such that information corresponding to the distance between the actual 
instrument and the point on the actual target can be directly observed from an 
alignment of the virtual target point and the virtual instrument by rcpocitioninq tho 





virtual instrumont wi th resp e ct to tho virtua l targot point using th e st ere o displ ay 
s o that tho virtu aM nstrum o nt moves toward alignment with th o t a rg e t . 
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Claim 38 (Original): The method of claim 35, wherein said rendering step is 
performed according to a virtual camera with a wide angle lens. 

Claim 39 (Currently Amended): The method of claim 37 35, wherein the virtual 
target point and the virtual instrument are each comprised of at least one ring 
centered on the target point respectively on the axis of the instrument, and a 
diameter of the at least one ring is dimensioned to achieve a pre-defined 
configuration together with the actual instrument when the actual instrument 
reaches the actual target. 

Claim 40 (Original): The method of claim 23, wherein the graphical 
representation from the virtual viewpoint is combined with another graphical 
representation from another virtual viewpoint looking at the virtual path from a 
side thereof. 

Claim 41 (Original): The method of claim 23, wherein said graphical 
representation from the virtual viewpoint is combined with an augmented reality 
view. 

Claim 42 (New): The method of claim 16 wherein the graphical target point 
and the graphical axis marker are designed such that information corresponding 
to the distance between the actual instrument and the point on the actual target 
can be directly observed from an alignment of the graphical target point and the 
graphical axis marker. 

Claim 43 (New): The method of claim 42, wherein the graphical target point 
and the graphical axis marker are each comprised of at least one ring centered 
on the target point respectively on the axis of the instrument, and a diameter of 
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the at least one ring is dimensioned to achieve a pre-defined configuration 
together with the actual instrument when the actual instrument reaches the actual 
target. 
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